Unstable recurrent patterns in Kuramoto-Sivashinsky dynamics 
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We undertake an exploration of recurrent patterns in the antisymmetric subspace of 1-dimensional 
Kuramoto-Sivashinsky system. For a small, but already rather "turbulent" system, the long-time 
dynamics takes place on a low-dimensional invariant manifold. A set of equilibria offers a coarse 
geometrical partition of this manifold. The Newton descent method enables us to determine numer- 
ically a large number of unstable spatiotemporally periodic solutions. The attracting set appears 
surprisingly thin - its backbone are several Smale horseshoe repellers, well approximated by intrinsic 
local 1-dimensional return maps, each with an approximate symbolic dynamics. The dynamics ap- 
pears decomposable into chaotic dynamics within such local repellers, interspersed by rapid jumps 
between them. 
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Statistical approaches to the study of turbulence [H, 
rely on assumptions which break down in presence of 
large-scale coherent structures typical of fluid motions . 
Description of such coherent structures requires detailed 
understanding of the dynamics of underlying equations 
of motion. In E. Hopf 's dynamical systems vision Q tur- 
bulence explores a repertoire of distinguishable patterns; 
as we watch a turbulent system evolve, every so often we 
catch a glimpse of a familiar whorl. At any instant and a 
given finite spatial resolution the system approximately 
tracks for a finite time a pattern belonging to a finite al- 
phabet of admissible patterns, and the dynamics can be 
thought of as a walk through the space of such patterns, 
just as chaotic dynamics with a low dimensional attrac- 
tor can be thought of as a succession of nearly periodic 
(but unstable) motions. 

Exploration of Hopf's program close to the onset of 
spatiotemporal chaos was initiated in Ref. which was 
the first to extend the periodic orbit theory to a PDE, the 
1-spatial dimension Kuramoto-Sivashinsky 0, @ system, 
a flow embedded in an infinite-dimensional state space. 
Many recurrent patterns were determined numerically, 
and the recurrent-patterns theory predictions tested for 
several parameter values. 

In this paper (and, in a much greater detail, in Ref. Q) 
we venture into a bigger Kuramoto-Sivashinsky system, 
just large enough to exhibit "turbulent" dynamics arising 
through competition of several unstable coherent struc- 
tures. Basic properties of the Kuramoto-Sivashinsky 
equation are reviewed in Sec. H] In Sec. |TT] we sketch the 
Newton descent method that we deploy in our searches 



for recurrent patterns. Equilibria, which play a key role 
in organizing the state space dynamics, are investigated 
in Sec, mil We then fix the size of Kuramoto-Sivashinsky 
system in order to illustrate our methodology on a con- 
crete example. In Sec. lIVI we show how intrinsic curvilin- 
ear coordinates are built along unstable manifolds, lead- 
ing to low-dimensional Poincare return maps. These en- 
able us to search systematically for periodic orbits that 
build up local Smale horseshoe repellers. Our results are 
summarized in Sec. IVl 



I. KURAMOTO-SIVASHINSKY EQUATION 

The Kuramoto-Sivashinsky system [1, @, Q 

Ut ^ {u'^)x - U^xx - l^U^xxx, (1) 

arises as an amplitude equation for interfacial instabilities 
in a variety of physical contexts H, Q • We shall study 
u{x,t) on a periodic domain x G [0,L], u{x,t) = u{x + 
L,t). In the Fourier space. 



i{x,t) = i ^ ak{t)t 



ikqx 



q = 27T/L , (2) 



k=-c 



Kuramoto-Sivashinsky PDE is represented by the infinite 
ladder of coupled ODEs for complex Fourier coefRcients, 



dk ^ {kqf (l - ly {kqfj Gk - kq ^ a 



+ 00 



m^k — m 



(3) 



'Electronic address: 
t Electronic address: 



ylan2® engineering, ucsb . edu | 



Predrag . C vitanovic@phy sics . gatech.edu | 



In this paper we restrict our investigation to the sub- 
space of odd solutions u{x,t) = ~u{—x,t) for which a/^'s 
are real, ag mode is conserved since a'o = and oq = 



/ dxu = since u has odd parity. The Hnear term con- 
trols the stabihty of the u{x, t) = equiUbrium, with each 
Fourier mode ak an eigenvector of the Unearized equa- 
tion, with eigenvalue uj{kq) — {kq)'^{l — v{kqY). If all 
eigenvalues are non-positive, the equilibrium u{x,t) — 
is globally stable. In general, the longest wavelengths 
are unstable, while the higher k contract rapidly, re- 
stricting dynamics to a finite-dimensional inertial mani- 
fold [lO, The peak of the w(fcg) stabihty curve iden- 
tifies the maximally unstable mode at fcg = 1/ and 
sets the typical wavelength of the large system size spa- 
tiotemporal patterns of the Kuramoto-Sivashinsky equa- 
tion. 

Rescaling t vt, at v^^^'^ak, L — 27rzy^/^L, results 

in 

-t-oo 

hk^ [k/LY {l- {k/Lf^ ak~ [k/L) ^ a^ak^m , 

m— — oo 

(4) 

where we trade in the "hyper- viscosity" v and the system 
size L for a single dimensionless length parameter 

L = L/ {27r^) , (5) 

which plays the role of a "Reynolds number" for the 
Kuramoto-Sivashinsky system. In the literature some- 
times L is used as the control parameter, with v fixed 
to 1, and at other times v is varied with L fixed. In 
what follows we find it most convenient to set ly — 1 and 
compare different calculations in terms of either L or L. 

For small L, the dynamics and bifurcation sequences 
are investigated in Refs. [1, [H [H, [13, . For L < 1 
equilibrium u = is the global attractor. As the system 
size L is increased, the "flame front" becomes increas- 
ingly unstable and turbulent. While for L sufficiently 
large existence of many coexisting attractors is an open 
possibility p^ . in numerical studies most initial condi- 
tions settle down in the same region of state space, the 
attractor with the largest basin of attraction. This is il- 
lustrated by Fig.[T]for system size L = 38.5, L = 6.12 • • • 
that we shall focus on in this paper. 

In the antisymmetric subspace the translational invari- 
ance of the full system reduces to the invariance under 
discrete translation hy x x + L/2. In the Fourier rep- 
resentation ([5]), the corresponding solution is obtained by 
reflection 

0.2m 0,2m , Q2m+1 ^ —02m+l ■ (6) 

II. METHOD OF NEWTON DESCENT 

We will investigate the properties of the Kuramoto- 
Sivashinsky equation in a weakly "turbulent" (or 
"chaotic" ) reg ime from the perspective of periodic or- 
bit theory [l7[ > and refer to the application of this theory 
to PDEs as the recurrent pattern program since here the 
coordination of spatial degrees of freedom plays a major 
role. 
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(b) ^1 (c) 

FIG. 1: Long-time evolution of a typical "sustained turbu- 
lence" trajectory for L — 38.5 in: (a) The space-time repre- 
sentation {u{x,t),t) for X e [0,L/2]], t € [0,7600]. The color 
(grayscale) represents the magnitude of u{x,t). (b) [01,02] 
Fourier modes projection, (c) [03,04] projection. The typi- 
cal time scale is set by the shortest periods of the unstable 
periodic orbits embedded in the central, "wobbly" and side, 
"traveling wave" patterns of order T = 20 ~ 25, see Fig. [S] 
so this is a very long simulation, over 300 "turnover" times. 
The goal of this paper is to describe the characteristic un- 
stable "wobble" and "traveling wave" patterns in terms of a 
hierarchy of invariant periodic orbit solutions. 

Christiansen et al. [1] proposed in 1996 that the peri- 
odic orbit theory be applied to spatio-temporally chaotic 
systems, using the Kuramoto-Sivashinsky system as a 
laboratory for exploring viability of the program. They 
examined the dynamics of the periodic b.c, antisymmet- 
ric subspace, for system sizes L w 5.8, close to the on- 
set of chaos, where a truncation of expansion ([H to 16 
Fourier modes already yields accurate results. The main 
result was that the high-dimensional (16-64 dimensions) 
dynamics of this dissipative flow could be reduced to an 
approximately 1—d Poincare return map, by constructing 
an invariant, unstable manifold-based curvilinear coordi- 
nate passing close to all unstable periodic orbits embed- 
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ded within the strange attractor. A binary symbohc dy- 
namics arising from this surprisingly simple return map 
made possible a systematic determination of all nearby 
unstable periodic orbits up to a given number of Poincare 
section returns. 

The essential limitation on the numerical studies un- 
dertaken in Ref. [i*] were computational constraints: in 
truncation of high modes in the expansion ([4]), sufficiently 
many have to be retained to ensure that the dynamics is 
accurately represented; on the other hand, recurrent pat- 
terns have to be located in this high-dimensional state 
space. High wave number modes have large negative co- 
efficients in the linear term of making the system 
stiff and the integration slow. Basic difhculties also ex- 
ist in the application of commonly used cycle-searching 
techniques [3, [l3|, due to the intricate orbit structure 
induced by strong nonlinearity. The integration of the 
associated Jacobian matrix can also be expensive due to 
the high dimensionality. 

The "Newton descent" method for determining unsta- 
ble spatio-temporally periodic solutions of extended sys- 
tems has been formulated and explored numerically in 
Refs. jl^, [lH. The idea of the method is to make a 
rough but informed guess of what the desired pattern 
looks like globally, and then use a variational method to 
drive the initial guess toward the exact solution, by min- 
imizing a cost function computed from the deviation of 
the approximate flow from the true flow, Fig.[2](a). 

We initiate our searches by a long-time numerical run 
of the dynamics, in order to identify the frequently vis- 
ited regions of the state space (natural measure), then 
search for close recurrences [lO]. An initial loop guess 
L(0) is crafted by taking a nearly recurring segment of 
the orbit, smoothed and made periodic by a FFT into 
the wave number representation, dropping the high fre- 
quency components, and an FFT back to the state space. 
In a loop discretization each point has to be specified in 
all d dimensions. A typical initial loop guess is displayed 
in Fig.[2](b,c), along with the periodic orbit found by the 
Newton descent method in Fig.[2](d). 



III. EQUILIBRIA OF THE KS EQUATION 

Equilibria (or the steady solutions) are the simplest 
invariant objects in the state space. Some of them are 
dynamically important as they, together with their unsta- 
ble/stable manifolds, partition the state space into qual- 
itatively different regions and offer a first, coarse descrip- 
tion of typical state space recurrent coherent structures. 
As we shall show here, each such region owns its own lo- 
cal Smale horseshoe hierarchy of unstable periodic orbits, 
and there are orbits communicating between different re- 
gions. 

The equilibria of the Kuramoto-Sivashinsky equation 
(P) satisfy 

)x '^xx ^xxxx — ■ 




(c) "i (d) 

FIG. 2: (a) The orientation of a tangent v{x) of the guess loop 
Z/(r) does not coincide with the orientation of the velocity 
field v{x); for a periodic orbit p it does so at every x £ p. 
The Newton descent method aligns the closed loop tangent 
to the given vector field by driving the loop to a periodic orbit. 
Newton descent at work for a Kuramoto-Sivashinsky system: 
(b) a near return extracted from a long-time orbit, (c) initial 
guess loop crafted from it, (d) the periodic orbit p reached by 
the Newton descent. = 512 points representation of the 
loop, [ai,a2] Fourier modes projection. 

Integrating once we get 

- Ma; - Uxxx = E , (7) 

where E is an integration constant .21] • Written as a 
3-d ODE, with spatial coordinate x playing the role of 
"time," this is a dynamical system [22| 

Ux =v , Vx = w , Wx = y? ~ V - E , (8) 

with the "time reversal" symmetry, 

X ^ —X, u ~> —u, V ^ V, w ^ —w . 

Rewriting ([5]) as 

{u + w)x = u'^ - E , 

we see that for E < 0, u -\- w increases without bound 
as X — > oo, and every solution escapes to infinity. If 
E — 0, the origin (0, 0, 0) is the only bounded solution, a 
marginally stable center with eigenvalues (0,i, —i). 

For E > there is rich £'-dependent dynamics, with 
fractal sets of bounded solutions. The solutions of ^ 
are themselves in turn organized b y it s own equilibria 
and the connections between them For E > the 
equilibrium points of ^ are c+ = {V^, 0, 0) and c_ = 
{—^/E,0,0). Linearization of the flow around c+ shows 
that c+ has a 1—d unstable manifold and a 2—d stable 
manifold along which solutions spiral in. By the x —x 
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"time reversal" symmetry, the invariant manifolds of c_ 
have reversed stability properties. Most orbits escape 
quickly even if initiated close to the non-wandering set, 
and that renders the numerical calculations difficult [23*, 
[13, m. Hi]. The Newton descent method jjj, il9i] that 
we employ appears more robust and effective than the 
earlier approaches. 

For a fixed spatial size L with periodic boundary condi- 
tion, the only equilibria are those with spatial periodicity 
L. The equilibria, represented as T^j^ ~. o^e''"^^, with 
q — 2'k/L and = —a,-k, satisfy [2l| 

oo 

{kqf {l - {kqf) ak + ikq ^ ai;_„a„ = . (9) 

m— — oo 

In analogy with Hamiltonian dynamics, we can say that 
we are looking for solutions of ([I]) of a given spatial period 
L, on any "£' shell," rather than looking for solutions of 
arbitrary period for a fixed "i5 shell." 

In the antisymmetric subspace considered here, the in- 
variance ^ under discrete translation by a; — > a; + L/2 
implies that every equilibrium solution is either invariant 
under 1/2-cell shift, or has a half-cell translated partner. 



A. Search for dynamically important equilibria 

For small system sizes L the number of equilibria is 
small and concentrated on the low wavenumber end of 
the Fourier spectrum. In a high-dimensional state space 
not all equilibria infiuence dynamics significantly, so we 
need to classify them according to their importance in 
shaping the long-time dynamics of ((1]). We gauge the 
relative importance of an equilibrium by its proximity to 
the most recurrent state space regions. Empirically, an 
equilibrium plays at least two roles. The more unsta- 
ble eigendirections it has (for example, the u = solu- 
tion), the more unlikely it is that an orbit will recur in 
its neighborhood: thus a highly unstable equilibrium can 
help elucidate the topology of an asymptotic attracting 
set by the "hole" that it cuts in the natural measure. 
On the other hand, the asymptotic dynamics can spend 
a large fraction of time in neighborhoods of a few "least 
unstable" equilibria, equilibria with only a few unstable 
eigendirections. Unstable manifolds of a set of such equi- 
libria tile state space with a set of regions explored by 
the asymptotic dynamics. 

We pick any point on a typical orbit of Q. It corre- 
sponds to a loop in the 3-(i state space of ([5]) and so can 
be used to initialize the search for an u{x) profile peri- 
odic on [0, L\. For L = 38.5 , = 1 we found in this way 
several dozen equilibria of (|3]). 

Next we re-initialize the search by taking the average 
of an orbit segment of (0]), with the hope that the typical 
orbit will pass through the neighborhood of important 
equilibria often. In this way, the number of dynamically 
important equilibria is greatly reduced: we find 10 solu- 
tions, 5 of which belong to the antisymmetric subspace. 
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FIG. 3; Equilibria in Michelson [u, ita:] representation [2^ . 
and as u{x) spatially periodic profiles: (a), (b) C\. (c), (d) C2. 
(e), (f) (g), (h) R2. (i), (j) T. L = 38.5, antisymmetric 
subspace. 



see Fig. [3] The corresponding E values and leading linear 
stability eigenvalues are listed in Tab. H] No other equi- 
libria seem to be dynamically important for this system 
size. 

In Tab.U "C" refers to the center in Fig.[T](b), "i?" to 
the right. The left equilibria "L" are omitted, as they 
are symmetry partners of "i?." The "Ci" equilibrium is 
self-dual with respect to the reflection and the rest 
come in pairs. 

The topology of equilibria is organized relative to the 
stationary points c+, c_ near the unstable spiral- in man- 
ifold of c+, the stable spiral-out manifold of c^. In 
Fig- [31(a,c), the equilibrium profiles circle the pair c+, c_ 
as a whole, and u has 4 peaks on [0, L], see Fig.|3](b) and 



5 





Hi 


^1 i % t^i 








0.43646 


0.044 


-0.255 


-0.347 






±i 0.261 


±i 0.431 


±i 0.463 


C2 


0.25784 


0.33053 


0.097 


-0.101 
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Ri 


0.36602 


0.011 


-0.215 


-0.358 






±j 0.796 


±j 0.549 


±i 0.262 


R2 


0.34442 


0.33223 


-0.001 


-0.281 








±i 0.703 


±i 0.399 


T 


0.40194 


0.25480 


-0.07 


-0.264 








±i 0.645 





TABLE I: Dynamically important equilibria in the antisym- 
metric subspace, periodic b.c: value of the integration con- 
stant E, as defined in ((T}, and the first few least unstable 
stability exponents. 

(d). In Fig. [3](e,g,i) the profiles encircle both equihbria 
as well as each separately. The circulation around the 
two equilibria ("of equilibria") may be used to classify 
the solutions. Each circulation gives a peak in the u pro- 
file on [0, L], with big circulations corresponding to large 
oscillations and small ones to the secondary oscillations. 

B. Equilibria and the dynamics 

Empirically the non-wandering set appears to consist 
of three regions: the left part {Sl), the center part {Sc) 
and the right part [Sr). By the inversion symmetry ([6]), 
Sl and Sr are mirror images of each other, so only one of 
them needs to be considered, say Sr. Within each region 
the dynamics takes place on a chaotic repeller, with orbit 
occasionally escaping a region and landing in the next 
region. Such rapid transitions show up as "defects" in 
the spatio-temporal evolution in Fig. [l](a). 

Judged by recurrences in the long-time dynamics, the 
weakly unstable Ci and i?i appear to be the most im- 
portant equilibria, with typical return times Ti = l-Kjvi: 
= 24.0, Tr^ = 7.89. In contrast, the dynamics ap- 
pears to steer clear of C2, equilibrium unstable in three 
eigen-directions. The T equilibrium appears to mediate 
transitions between the side and the center regions. Af- 
ter checking all projections of a typical long orbit onto 
all [ai , Qj] planes, we found that the dynamics frequents 
only the neighborhoods of the equilibria listed in Tab. [H 

Segments of a typical orbit in the non-wandering set 
bear close resemblance to the equilibria listed in Fig. [31 
The {u,Ux) representations and the spatial profiles of 
three typical instants in the long-time evolution of Fig. 3] 
resemble the equilibria shown in Fig.[TJ Fig.[4](c) is simi- 
lar to Fig. [31(c) and Fig. [1(a) is similar to Fig.[3](a). The 
state in Fig.[5|(e), which lies along the transition from Sr 
to Sc, has no clear equilibrium counterpart. So, at this 




(e) "(x.t) (f) 



FIG. 4: The spatial profile of u{x,t) at a instant t when (a), 
(b) a typical trajectory passes Sc', (c), (d) or Sr; (e), (f) or 
equilibrium T, the transition region between central region 
Sc and the side region Sr.. Compare with Fig. [S] 



stage, equilibria partition the state space at the coarsest 
level into alphabet {Sl , Sc , Sr\. 



IV. RECURRENT PATTERNS 

In this section we investigate the recurrent patterns 
in the KSe dynamics by constructing the unstable man- 
ifolds of dynamically important invariant sets. We de- 
fine intrinsic curvilinear coordinates along unstable man- 
ifolds, then deduce return maps and construct approx- 
imate symbolic dynamics which greatly facilitates the 
search for unstable periodic orbits. This program is quite 
successful for the "center," Sc part, but less so for the 
"side," Sr part. 

All numerical work presented here is for system size 
L = 38.5 , = 1, chosen large enough to exhibit spatially 
nontrivial competition between various chaotic patterns. 
Wc find that the 16 Fourier mode truncation is sufficient 
for our purposes 0, [isj ; the equilibria and periodic orbits 
change by a few percent if the number of modes is dou- 
bled. The translational invariance of ([1]) in the full state 
space implies that relative equilibria and periodic orbits 
could play important role [27|. The restriction to the 
antisymmetric subspace excludes this type of solutions. 
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(C) ^1 (d) 

FIG. 5: [ai,a2] Fourier modes projection of several shortest 
periodic orbits in Sc- The periods are (a) T — 25.6095; (b) 
T = 25.6356; (c) T = 36.7235; (d) T = 37.4083. 




(c) (d) 

FIG. 6: (a) The shortest periodic orbit pu2 in Sr, T = 
12.0798, [as, 04] Fourier modes projection, (b) The second 
shortest periodic orbit pm in 5b, T = 20.0228, [03, 04] projec- 
tion. A long periodic orbit connecting Sc in Sr, T = 355.34: 
(c) [01,02] projection, (d) [03,04] projection. 



A. Poincare sections 

We initialize our periodic orbit searches by checking 
for the nearly recurrent orbit segments. Motivated by 
Fig. [T](b), we choose the hyperplane ai = as our 
Poincare section for searches within Sc- The shortest 
unstable periodic orbits residing in Sc are displayed in 
Fig. [51 Each of them has a partner related by the re- 
flection symmetry ([B]), except for the symmetric one. 
Fig. [5](a), which is self-dual under the reflection. The 
Poincare section for Su is chosen as 04 = —0.122. The 
shortest unstable periodic orbits residing in Sr are de- 
picted in Fig. [n](a,b). Each of them has a symmetry 
partner in 5'^. The one in Fig. [6](a) is seen to mediate 
the transition from Sr to Sc, and the one in Fig. [S](b) 
will be used to build a symbolic dynamics in Sr. All 
periodic orbits that we have found have only one unsta- 




(a) ^1 (b) 

FIG. 7: The projection of a typical state space trajectory 
segment onto the linearized stability eigenplanes of equilibria 
Ci and Ri. (a) The projection of part of the center orbit to 
the eigenplane (61,62) of Ci; (b) The projection of part of the 
right-sided orbit to the eigenplane (61,62) of Ri. 

ble eigendirection, enabling us to construct a 1—d map to 
model the state space dynamics on some chosen Poincare 
section. 

Fig. [n](c,d) shows a long, period T = 355.34 periodic 
orbit that communicates between Sc and Sr. We ini- 
tialize the search for this orbit by choosing a segment of 
long-time orbit that communicates between Sc and Sr. 
Several of such long communicating periodic orbits are 
found with similar or longer period. 

The unstable manifolds of all periodic orbits found so 
far rarely have more than two unstable eigendirections. 
This is consistent with the estimated linear growth of the 
Hausdorff dimension of the non-wandering set with the 
system size j28j. In general, there exist many unstable 
periodic orbits with many unstable directions, but they 
do not appear to participate in the asymptotic dynam- 
ics. Although more than 50 unstable periodic orbits were 
found in our preliminary search, we have no criterion that 
would preclude the possibility of more important ones yet 
to be detected. 

In the preliminary search, we chose the Poincare sec- 
tion by examining Fig. [T] A good Poincare section is 
essential to the success of all subsequent steps. It should 
cut all the orbits in the non-wandering set transversely 
and should be numerically convenient; all our Poincare 
sections are hyper-planes. After a Poincare section is cho- 
sen, we determine the symbolic dynamics by examining 
the return map defined on the Poincare section. In our 
case, the unstable manifold of the shortest orbit is nearly 
1-dimensional and the dynamics can be approximated by 
maps defined on 1-d line segments. 

According to Tab. U the least unstable equilibria Ci 
and Ri have 2-d spiral-out unstable manifolds. In the 
neighborhood of Ci and Ri the unstable manifolds are 
well approximated by the corresponding eigenplanes de- 
termined by their complex eigenvalue pairs. The projec- 
tions to the eigenplanes of nearby long-time orbit seg- 
ments in Fig. [T](b) are displayed in Fig. [T] Fig. [7](a) 
shows a projection onto the eigenplane ei — 62 of the 
center equilibrium Ci (origin in the figure); the orbit 
is circling and avoiding Ci. At the left and the right 
bounds, there are extra orbit rotations which have a ro- 
tation plane roughly perpendicular to the ei — 62 eigen- 
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plane. It turns out that this rotation is related to the 
transition equilibrium T. Thus, the dynamics of the cen- 
tral part is controlled by Ci and T (and T*, the sym- 
metric image of T) with the orbit spending most of the 
time around Ci . An obvious choice of the Poincare sec- 
tion is Vc : xi — 0, where xi — [x ~ x{Ci)) ■ ei is the 
projection of the state space point x relative to the equi- 
librium Ci along the ei direction. Fig. [7](b) shows the 
projection onto the eigenplane ei — 62 of the right-side 
equilibrium Ri (at the origin (0,0) in the figure). We 
see that most of the time the orbit circles around 
There are many small oscillations near the bottom, in 
this projection partially masked by the dense band. In 
the following, Vr : xi = (different from the center one) 
is taken to be the Poincare section. This is not a perfect 
choice as the occasional tangent passage of the orbit to 
Vr can cause trouble. 



B. Curvilinear coordinates, center repeller 

By construction, the section Vc contains Ci and the 
eigenvector 62 and is perpendicular to the ei — 62 ex- 
panding eigenplane of Ci. We compute the intersection 
of the Poincare section Vc with the 2-dimensional un- 
stable manifold of Ci by iterating [2^ a set of initial 
points on the ±62 eigenvector, infinitesimally close to 
Ci. At nearest "turn-back points" the unstable mani- 
fold bends back sharply and then nearly retraces itself, 
see Fig. |S](a,b). Denote by Lc the "base segment" of 
the unstable manifold between the two nearest turn-back 
points that bracket Ci. Fig.[8](c) shows the first iterate of 
Lc'- finer structures do develop, but on the whole they lie 
close to Lc and should be well described bythe intrinsic 
curvilinear coordinate that we now define [4]. 

Assign to each d-dimensional point x € Lc a coordi- 
nate s — s{x) whose value is the Euclidean arc length to 
Ci measured along the 1-dimensional Vc section of the 
Ci unstable manifold. Next, for a nearby point xq ^ Lc 
determine the point xi e Lc which minimizes the Eu- 
clidean distance (xq — xi)^, and assign arc length coordi- 
nate value So = s(xi) to xq. In this way, an approximate 
1-dimensional intrinsic coordinate system is built along 
the unstable manifold. This parametrization is useful if 
the non-wandering set is sufficiently thin that its per- 
pendicular extent can be neglected, with every point on 
the non-wandering set assigned the nearest point on the 
base segment Lc- 

Armed with this intrinsic curvilinear coordinate 
parametrization, we are now in a position to construct 
a 1-dimensional model of the dynamics on the non- 
wandering set. If Xn is the nth Poincare section of a tra- 
jectory in neighborhood of Ci, and s„ is the correspond- 
ing curvilinear coordinate, then s„+i — f{sn) models the 
full state space dynamics Xn Xn+i- We define /(s„) as 
a smooth, continuous 1-dimensional map / : Lc — > Lc 
by taking Xn G Lc, and assigning to x„+i the nearest 
base segment point s„+i = s{xn+i)- 
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FIG. 8: The Fourier modes projection of the unstable mani- 
fold segment Lc of Ci on the Poincare section Vc- (a) [ai, 02] 
projection of the unstable manifold on Vc- (b) [03,04] pro- 
jection {Lc is represented by 564 points), (c) Projection of 
the first iteration of Lc- (d) Projection of all computed un- 
stable periodic orbits of the full domain topological length 
up to n = 8. The Poincare return map on Vc, the intrinsic 
coordinate: (e) The bimodal return map in the fundamental 
domain, with the symbolic dynamics given by three symbols 
{0,1, 2}. (f) The periodic points in the fundamental domain, 
overlayed over the return map (e). 



This Poincare return map is multi-modal and, due 
to the discrete symmetry (j6|), antisymmetric under the 
s — > —s reflection. This discrete symmetry ^ can be 
profitably used to simplify the symbolic dynamics p7| . 
Defining the s > segment as the fundamental domain, 
the return map for the fundamental domain is partitioned 
by two points {0.2825,0.6905} into a 3-letter alphabet 
{0,1, 2}, see Fig.[8](e). The chaos generating mechanism 
- stretching and folding - is clearly illustrated by this re- 
turn map. The dynamics can now be approximated by a 
subshift of finite type in the space of symbol sequences 
built from these three letters [l3, [13] ■ 

The distribution of the points on the return map is 
highly non-uniform. This is consistent with the Poincare 
section Fig. [H](c) for which the vertical segments in the 
middle contain fewer representative points than other 
segments. Our studies indicate that the dynamics in 
this region of state space is controlled by the "transi- 
tion" equilibrium T. T has a much stronger repelling rate 
{fiT ~ 0.2548) than the Ci equilibrium, {fj,c, ~ 0.04422, 
see Tab.|l]). A line segment is strongly stretched by a close 
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FIG. 9: The [ai,a2] Fourier modes projection of two cycles 
in Sc listed in Tab. Ull (a) cycle 0011, (b) cycle 0012. Two 
short typical cycles not listed in the table: (c) a symmetric 
unstable periodic orbit in Sc with the period T = 77.4483, (d) 
an asymmetric unstable periodic orbit in Sc with the period 
T = 81.3345. 



passage to T, and its representative points get very sparse 
upon one Poincare iteration. This indicates that the dy- 
namics in the center region of state space is coarsely or- 
ganized by the two equilibria, Ci and T. 

The return map /(s) leads to approximate finite 
Markov diagrams and the associated symbolic dynam- 
ics, enabling us to search for unstable periodic orbits 
in a systematic fashion. Up to length 4, the pruning 
rule implied by Fig. [8](e) precludes symbol sequences 
{21,22,202,2010}. We find all unstable periodic orbits 
of period n within Sc by first determining the zeros of 
the 1-dimensional map /"(s) {i.e., the n-periodic points 
of /(s)), and then initiating the Newton descent by the 
corresponding points in the full state space. Whenever 
the 1—d model map is a good representation of the full 
state space dynamics, this approach yields a periodic or- 
bit for every admissible itinerary, of arbitrary period. 

For the "center" region Sc the return map of 
Fig. [8](e,f ) appears to be a good description of full state 
space dynamics. We found all admissible orbits up to 
length 8, and list the orbits of fundamental domain pe- 
riods up to 4 in Tab. |lTl The cycles with n odd are 
symmetric under the reflection ([6]) , while the cycles with 
n even are either self-dual or have a symmetry partner. 
Few examples are plotted in Fig. [51 

All unstable periodic orbits we found in Sc have one 
unstable eigendirection, with other eigendirections highly 
contracting, which justifies partially the 1—d description 
of the dynamics. Fig. [5](d) shows the Vc periodic points 
of periods up 8; the set agrees well with the unstable 
manifold section of Fig. [5](c). Fig. [5](f) displays the re- 
turn map in the fundamental domain reconstructed from 
these periodic points. It matches well the map Fig. [5](e), 
with the exception of an "outlier" cycle, denoted 0001* 
in Tab. |TT1 which shares the symbol sequence with cycle 



-0.34p 
-0.35 
ro' -0.36 
-0.37 




-0.38^- 



(b) 



-0.12p 
-0.13 
J -0.14 
-0.15 
-0.16 



(d) 



0.235 0.24 

a. 



0.04 
0.02 



-0.02 



0.04-0.02 0.02 0.04 

(e) s 



(f) 



0.04 
0.02 


-0.02 



04-0.02 0.02 0.04 
S 



FIG. 10: The Fourier modes projections of the unstable man- 
ifold Lr of cycle on the Poincare section Vr: (a) [ai,a2] 
projection of the unstable manifold on Vr. (b) [03,04] pro- 
jection of the unstable manifold on Vr. Projection of (c) the 
first iteration of Lr, (d) the second iteration of Lr. The 
Poincare return map on Vr, intrinsic coordinate: (e) The re- 
turn map is unimodal, with alphabet {0,1}. (f) The return 
map reconstructed from the periodic points (diamonds). For 
comparison, the unstable manifold return map is indicated by 
the dots. 



{0001}. The same "outlier" is visible in the center of 
the lower- left quadrant of Fig. [5](d). This point lies on 
another branch of the attractor, defined by a different 
turn-back point. Cycles depicted in Fig. [5](a,c,d) and 
Fig. [n](c,d) also belong to other branches, and are not 
listed in Tab. Ull There are infinitely many turning points 
and unstable manifold folds; our description accounts for 
only one important part of Sc. 

To summarize: the approximate 1-dimensional dynam- 
ics based on the closest turn-back pair interval bracketing 
the Ci equilibrium unstable manifold suffices to establish 
existence of a Smale horseshoe in this neighborhood. A 
more accurate description would require inclusion of fur- 
ther turn-backs [3U, w2l ■ 



C. Side repeller 

The dynamics within the "side" repeller Sr appears 
more complicated than the one discussed above for the 
"center" C/j. In this case our local Poincare return map 
captures only a small (though important) subset of the 
Sr non- wandering set. For the Sr case, we utilize the 
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TABLE II: Cycles up to topological length 4 for the "center" repeller in the fundamental domain; cycles up to topological length 
8 for the "side" repeller. Listed are the topological lengths, the itineraries p, the largest Lyapunov exponents Xp = In \Ap,i\/Tp , 
periods Tp, the first three (four) stability eigenvalues. Our approximate symbolic dynamics fails to resolve cycles 0001 and 
0001*. 

"Center" periodic orbits 





P 


Xp 


Tp 


Ai 


A3 


A4 


1 


1 


0.0946 


12.8047 


-3.3581 


0.20299 


0.008861 


2 


01 


0.07363 


25.6356 


-6.6028 


0.004697 


-0.0003854 


3 


001 


0.05814 


38.7241 


-9.5 


0.0001186 


3.687817783-10-* 




Oil 


0.0698 


38.4520 


14.6402 


5.0398-10-^ 


0.00029158 




002 


0.04558 


37.8160 


8.6967 


1.01538-10-* 


5.1672-10-^ 


4 


0001 


0.04647 


52.5998 


-11.5219 


1.3912-10"^ 


-3.4661-10"^ 




0001* 


0.05511 


57.7721 


-24.1326 


4.1012-10~^ 


-6.6332-10"^ 




0011 


0.05736 


51.8915 


19.6194 


-7.5089-10"^ 


2.3526-l-i 2.4938-10 




0111 


0.07977 


51.2393 


-59.5683 


0.0001284 


-1.0469-10'* 




0002 


0.047 


57.3329 


14.802 


7.8781-10"^ 


-5.0674-10"^ 




0012 


0.05103 


58.0857 


-19.3765 


-6.9811-10"^ 


-3.5525-10"* 



"Side" periodic orbits 



P 



At) 



Tp 



Ai 



A3 



A4 



1 0.02747 20.0228 -1.7333 -0.433 

2 01 -0.006163 40.0565 -0.5569-hi 0.5479 1.4892-10' 

6 000001 0.01113 120.1658 -3.8073 -0.05628 

7 0000101 0.02363 140.196 -27.4733 -0.006032 



00001001 0.03375 160.2561 223.2796 



0.0005662 



0.001 158-l-i 0.0002633 

1.2363-10"^ 

-4.03-10"^° 

-6-10'^^ 

-1.202-10'^ 



unstable manifold of the n — 1 cycle shown in Fig. [6](b) 
and listed in Tab.HTlas cycle "0." The unstable manifold 
has two intersections with the Poincare section Vr; we 
take the upper one (along 62) as the origin from which 
to measure arc length s. 1— d unstable eigenvector of the 
cycle fundamental matrix is then used to construct the 
1-dimensional, arc-length parametrized base segment of 
the unstable manifold Lr, as in the preceding section 
and Ref. [1^. We represent it numerically by 82 points. 
Fig. llOI (a.b) shows the [ai, 02] and [03, 04] Fourier modes 
projection of Lr. 

Fig. [Tn](c) shows the first iterate of Lr, with a clear 
indication of a turn-back. Fig. [TOKd) indicates a sec- 
ond turn-back arising from the second iteration of Lr. 
Higher iterations show still finer turn-back structures. 
The approximate return map displayed in Fig. [TUKe) is 
unimodal, with the two symbols {0,1} representing the 
two monotone laps, partitioned by the critical point at 
s = 0.034. The corresponding pruning rules up to length 
8 precludes the existence of sequences {11, 1001, 10000}, 
so the set of admissible subsequences up to length 8 is 
{0, 01, 0001, 000101, 00010101}. 

The search based on this symbolic dynamics yields cy- 
cles up to length n = 8 listed in Tab. [Til Note that the 01 
cycle is attractive, and thus not part of the repeller Sr. 
This approximate symbolic dynamics predicts that all cy- 




FIG. 11: (a) [as, 04] Fourier modes projection of the attract- 
ing periodic orbit 01 within Sr. (b) A nearby unstable peri- 
odic orbit within Sr. 

cles of lengths n ~ 6, 7, 8 are pruned; nevertheless such 
cycles do exist. Furthermore, the admissible sequences 
such as 0001 have no corresponding unstable periodic or- 
bits. Fig.[Tn](f) shows the unstable manifold return map 
superimposed on the one constructed from the periodic 
points (diamonds). The return map here captures only 
the gross features of the overall dynamics of the unstable 
periodic orbits. All this indicates that in this case our 
simple 1-diniensional model dynamics is not as a good 
description as that for Sc. 

To summarize: the Newton descent enables us to de- 
termine all symbolic dynamics admissible unstable peri- 
odic orbits on Sc up to topological length n = 8. The 
Poincare return map guided Newton descent searches for 
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Sr were not as successful, yielding only the small set of 
unstable periodic orbits listed in Tab. [Ill 

However, even partial knowledge of symbolic dynam- 
ics implied by the approximate return map of Fig. 1101 (e) 
leads to a very interesting discovery of the attracting pe- 
riodic orbit of period T ~ 40.0565, Fig. [TT](a). A nearby 
unstable periodic orbit of period T = 60.1112 of similar 
appearance is shown in Fig. [TT](b). In studies of turbu- 
lence in fluids only known stable solutions are the lami- 
nar equilibria, but, from the dynamical systems point of 
view, for higher-dimensional flows any number of coex- 
isting attractors can exist. The above nontrivial stable 
state would never be observed in a long-time, random 
initial conditions numerical simulation of the flow, as its 
immediate basin of attraction is an exceedingly small is- 
land embedded within the "sustained turbulence" region 
of state space. 

V. SUMMARY 

The recurrent patterns program was first implemented 
in detail [1] on the 1-d Kuramoto-Sivashinsky system at 
the onset of chaotic dynamics. For these specific pa- 
rameter values many recurrent patterns were determined 
numerically, and the periodic-orbit theory predictions 
tested. In this paper we venture into a large Kuramoto- 
Sivashinsky system, just large enough to exhibit "turbu- 
lent" dynamics of topologically richer structure, arising 
through competition of several unstable coherent struc- 
tures. Both papers explore dynamics confined to the 
antisymmetric subspace, space for which periodic or- 
bits characterize "turbulent" dynamics. Ref. [33] studies 
Kuramoto-Sivashinsky in the full periodic domain, where 
relative periodic orbits due to the continuous transla- 
tional symmetry play a key role, and Ref. [s^ applies 
the lessons learned to a full 3D Navier-Stokes flow. In 



this context Kawahara and Kida have demonstrated 
that the recurrent patterns can be determined in turbu- 
lent hydrodynamic flows by explicitly computing several 
important unstable spatio-temporally periodic solutions 
in the 3-dimensional plane Couette turbulence. 

We have applied here the "recurrent pattern program" 
to the Kuramoto-Sivashinsky system in a periodic do- 
main, antisymmetric subspace, in a larger domain size 
than explored previously The state space non- 

wandering set for the system of this particular size ap- 
pears to consist of three repelling Smale horseshoes and 
orbits communicating between them. Each subregion is 
characterized by qualitatively different spatial it-profiles 
in the l—d physical space. The "recurrent patterns," iden- 
tified in this investigation by nearby equilibria and pe- 
riodic orbits, capture well the state space geometry and 
dynamics of the system. Both the equilibria and periodic 
orbits are efficiently determined by the Newton descent 
method. The equilibria so determined, together with 
their unstable manifolds, provide the global frame for 
the non-wandering set. We utilize these unstable man- 
ifolds to build 1—d curvilinear coordinates along which 
the infinite-dimensional PDE dynamics is well approxi- 
mated by 1-dimensional return maps and the associated 
symbolic dynamics. In principle, these simple models of 
dynamics enable us to systematically classify and search 
for recurrent patterns of arbitrary periods. For the par- 
ticular examples studied, the approach works well for the 
"central" repeller but not so well for the "side" repeller. 

Above advances are a proof of principle, first steps in 
the direction of implementing the recurrent patterns pro- 
gram. But there is a large conceptual gap to bridge be- 
tween what has been achieved, and what needs to be 
done: Even the flame flutter has been probed only in its 
weakest turbulence regime, and it is an open question to 
what extent Hopf 's vision remains viable as such spatio- 
temporal systems grow larger and more turbulent. 
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